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Background: Human papillomavirus (HPV) testing in oropharyngeal squamous cell carcinoma (OPSCC) is now advocated. 
Demonstration of transcriptionally active high-risk HPV (HR-HPV) in fresh tumour tissue is considered to be the analytical 'gold 
standard'. Clinical testing has focused on formalin-fixed paraffin-embedded (FFPE) tissue at the expense of sensitivity and 
specificity. Recently, a novel RNA in situ hybridisation test (RNAscope) has been developed for the detection of HR-HPV in FFPE 
tissue; however, validation against the 'gold standard' has not been reported. 

Methods: A tissue microarray comprising FFPE cores from 79 OPSCC was tested using HR-HPV RNAscope. Analytical accuracy 
and prognostic capacity were established by comparison with the reference test; qRT-PCR for HR-HPV on matched fresh-frozen 
samples. 

Results: High-risk HPV RNAscope had a sensitivity and specificity of 97 and 93%, respectively, against the reference test. Kaplan- 
Meier estimates of disease-specific survival (DSS, P = 0.001) and overall survival (OS, P<0.001) by RNAscope were similar to the 
reference test (DSS, P = 0.003, OS, P<0.001) and at least, not inferior to p16 immunohistochemistry +/- HR-HPV DNA-based 
tests. 

Conclusion: HR-HPV RNAscope demonstrates excellent analytical and prognostic performance against the 'gold standard'. These 
data suggest that the test could be developed to provide the 'clinical standard' for assigning a diagnosis of HPV-related OPSCC. 



The last three decades have seen a fundamental change in the 
profile of oropharyngeal squamous cell carcinoma (OPSCC) within 
the developed world (Chaturvedi et al, 2011). The incidence of 
OPSCC attributable to tobacco and alcohol exposure has been 
gradually declining while human papillomavirus (HPV) -related 
OPSCC has seen a rapid increase (D'Souza et al, 2007; Sturgis and 
Cinciripini, 2007; Nasman et al, 2009; Schache et al, 2011). It is 
now clear that HPV-positive OPSCC is a biologically distinct entity 



(Gillison et al, 2000; Adelstein et al, 2009). Detection of high-risk 
HPV (HR-HPV) has profound prognostic significance as it 
correlates with both a disease-specific and an overall survival 
(OS) advantage (Fakhry et al, 2008; Lassen et al, 2009). The 
improved survival of these patients has prompted the formulation 
of clinical trials in both North America (RTOG 1016) and Europe 
(DeESCALaTE-HPV) to test the feasibility of de-escalation of 
therapy to reduce acute and late toxicity. Despite a consensus 
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within the head and neck oncology community that acknowledges 
the importance of HPV testing ( Adelstein et al, 2009; Nasman et al, 
2009; Marur et al, 2010; Mehanna et al, 2012), a validated reference 
test to establish a diagnosis of HPV-related OPSCC in clinical 
practice has yet to be established (Braakhuis et al, 2009; Robinson 
et al, 2010). 

As both the initiation and maintenance of an HPV- driven 
carcinoma requires persistent viral oncogene expression (Marur 
et al, 2010), the detection of E6/E7 mRNA transcripts by 
quantitative reverse transcriptase PCR (qRT-PCR) has been 
proposed as the most appropriate 'gold standard' or reference test 
(Smeets et al, 2007). As a consequence of RNA instability, this 
testing has relied on both the analysis of fresh-frozen tissue and 
specialist research laboratory techniques, thus limiting its transla- 
tion to routine clinical diagnostics (Smeets et al, 2007). For clinical 
utility, HPV testing strategies have necessarily focused on 
formalin-fixed paraffin-embedded (FFPE) tissue, but this has been 
at the expense of reduced sensitivity and specificity for oncogenic 
HPV (Smeets et al, 2007; Schache et al, 2011). Diagnostic 
algorithms that combine different HPV tests have been proposed 
as a strategy to compensate for the known limitations of individual 
tests (Westra, 2009). However, the inclusion of multiple analytical 
stages to achieve an accurate and reliable HPV status is technically 
cumbersome, may produce discordant results across the different 
tests employed and inevitably increases costs. 

Recent evidence suggests that a novel RNA-based chromogenic 
in situ hybridisation (ISH) technique (RNAscope, Advanced Cell 
Diagnostics Inc., Hayward, CA, USA) is capable of reliably 
detecting transcriptionally active genes, including HR-HPV E6/ 
E7 oncogenes, in FFPE tissue samples (Wang et al, 2012). The 
technique has shown promising results by comparison with other 
FFPE-based HPV diagnostic tests in head and neck cancer (Ukpo 
et al, 2011; Bishop et al, 2012; Lewis et al, 2012) and also informs 
prognosis in OPSCC (Ukpo et al, 2011); however, for this test to be 
considered for broader clinical usage its efficacy should be 
measured against an analytical 'gold standard'. Using a cohort of 
well -characterised OPSCC, comprising matched fresh-frozen and 
FFPE tumour samples, we sought to validate HR-HPV RNAscope 
against the reference test for oncogenic HPV; qRT-PCR for HPV- 
16, -18 and -33 E6/E7 transcripts. 



MATERIALS AND METHODS 



Case selection. Biopsy or excision material was available for 
79 cases originating from a cohort of stringently classified OPSCC 
cases (Schache et al, 2011). All samples had been sourced in 
compliance with previously granted ethical approval (South Sefton 
Research Ethics Committee; EC.47.01-6 & North West 5 Research 
Ethics Committee; EC.09.H1010.5) from individuals treated in the 
Liverpool Head and Neck Oncology Service, a multidisciplinary 
unit serving a geographically stable population of approximately 
two million individuals within Merseyside and Cheshire, UK. All 
cases had been treated using primary surgery and where required, 
adjuvant radiotherapy or chemoradiotherapy. 

Samples corresponding to each case had previously been tested 
using a portfolio of HPV tests (HPV-16, -18, -33 qRT-PCR and 
DNA qPCR performed on fresh tissue: pl6 immunohistochemistry 
(IHC) and HR-HPV DNA ISH performed on FFPE tissue, capable 
of detecting HR-HPV types -16, -18, -31, -33, -35, -39, -45, -51, 
-52, -56, -58 and -66), and were associated with clinically validated 
demographic and outcome data (Schache et al, 2011). 

Briefly, tissue microarrays (TMAs) consisting of triplicate tumour 
cores from corresponding FFPE tumour donor blocks were 
constructed. Both pl6 IHC and HR-HPV DNA ISH analysis was 
conducted using proprietary kits (CINtec Histology, mtm laboratories 



AG, Heidelberg, Germany; Inform HPV III Family 16 Probe B, 
Ventana Medical Systems Inc., Tucson, AZ, USA) on a Ventana 
Benchmark Autostainer (Ventana Medical Systems Inc.). 

Duplicated real-time DNA and RNA (cDNA) qPCR reactions 
were conducted using fresh tumour tissue-derived nucleic acid 
samples on an Applied Biosystems 7500 FAST system (Foster City, 
CA, USA). Further assay details including primer/probe sequences, 
PCR conditions and endogenous references have been published 
previously (Schache et al, 2011). 

RNA ISH for HR-HPV. Detection of HR-HPV E6/E7 mRNA in 
TMA cores was performed using the HR-HPV RNAscope kit 
(Advanced Cell Diagnostics Inc.) as previously described (Ukpo 
et al, 2011) and in accordance with the manufacturers instructions. 
Briefly, 4 /mi TMA sections were deparaffinised and pretreated 
with heat and protease before hybridisation with target- specific 
probes for the E6 and E7 genes of seven HR-HPV genotypes 
(HPV-16, -18, -31, -33, -35, -52 and -58). Ubiquitin C (UBC, a 
constitutively expressed endogenous gene) and the bacterial gene, 
dapB, were used as positive and negative controls, respectively. 

Whole-tissue sections for selected cases (see below) were stained 
for HR-HPV RNA, UBC and dapB by a fully automated RNAscope 
assay (RNAscopeVS) using the Ventana Discovery XT slide 
autostaining system (Ventana Medical Systems Inc.). 

Interpretation of tests. Test assessment was conducted indepen- 
dently by two pathologists (M.R. and P.S.) for all tissue-based 
analyses. 

Scoring of pl6 IHC status was assessed using the widely used 
threshold of strong and diffuse nuclear and cytoplasmic staining in 
^70% of the tumour (Singhi and Westra, 2010) and the recently 
proposed and validated H score for pl6 IHC, with an H score of 
>60 defined as pl6 positive (Jordan et al, 2012). 

High-risk HPV DNA in situ hybridisation was scored using a 
binary classification (positive vs negative) to reflect any detectable 
chromogen in any of the malignant cells, as described previously 
(Schache et al, 2011). 

For RNAscope, the UBC test was used to assess the presence of 
hybridisable RNA and was defined as adequate if there was strong 
staining in the majority of cells in the section. The dapB test was 
used to assess nonspecific staining; only those cases that were 
negative or weakly stained were considered for HPV scoring. A 
positive HPV test result was defined as punctate staining that 
co-localised to the cytoplasm and/or nucleus of any of the 
malignant cells and, where staining was present in the control, was 
at least twice as strong as the dapB test. 

The results were collated by the study coordinator (A.G.S) and 
discordant scores were re-examined at a meeting between the 
pathologists to establish a consensus interpretation. In order to 
quality assure the results, cases that had discordant scores between 
the pathologists and/or variable scores between cores from the 
same tumour were additionally subjected to analysis of whole- 
tumour sections as described above. 

Statistical analysis. The % 2 and Kruskal-Wallis tests were used for 
comparison of demographic and tumour- specific features between 
HPV-positive and -negative groups as defined by the reference test; 
HPV-16, -18, -33 qRT-PCR. Only tumours displaying viral 
oncogene expression in duplicate runs of qRT-PCR were deemed 
as harbouring oncogenic HPV. Analytical sensitivity and specifi- 
city, measured against the reference test, was calculated for 
HR-HPV RNAscope and for other single and combined diagnostic 
tests (HPV-16 DNA qPCR, pl6 IHC and HR-HPV DNA ISH). 
Positive and negative predictive values were similarly generated for 
each test. Median follow-up was estimated using the Kaplan-Meir 
potential follow-up method (Schemper and Smith, 1996). Kaplan- 
Meier estimates of survival were generated for single tests (high- 
risk qRT-PCR, HR-HPV RNAscope, HPV-16 DNA qPCR, 
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HR-HPV DNA ISH, pl6 IHQ) and combined analysis tests (pi 6 
IHC/HR-HPV qRT-PCR, pl6 IHC/HPV-16 DNA qPCR, pl6 
IHC/HR-HPV DNA ISH). The log-rank (Mantel-Cox) test was 
used for comparison between survival curves according to each of 
the diagnostic methods. Disease- specific survival (DSS) was 
defined as death from or owing to OPSCC, and OS was defined 
as death from any cause. Both DSS and OS were calculated at 36 
months follow-up beyond the date of initial diagnosis. 

To ensure that the ability to amplify target sequences for the 
defined reference test (HR-HPV qRT-PCR) was not adversely 
affected by duration of tissue storage, RNA quality was assessed 
by a Kruskal-Wallis test of the ACT of endogenous reference gene 
(jff-actin). 



RESULTS 



Tissue sample quality and consistency. Interpretable results were 
available for all 79 cases identified; however, one case had 
insufficient staining for UBC and was excluded from further 



analysis, leaving 78 of 79 (99%) cases for HPV analysis. Seventeen 
cases (22%) had discordant scores following TMA analysis, due 
either to inter-observer variation or inter-core variation, and were 
subject to further testing and independent scoring using whole 
FFPE sections. A resultant Kappa scope of 0.948 (95% CI 0.88-1.0) 
for inter- observer analysis of scoring was evident following 
complete analysis. The tumour cell proportion within fresh-frozen 
tissue samples was estimated to be > 50% for all cases and > 80% 
for two-thirds of the cohort. There was no evidence of statistically 
significant variation in reference gene detection (cycle to threshold 
for /?-actin) over time suggesting sample storage had no effect on 
detection of viral oncogene expression. 

Cohort characteristics. The entire cohort had a median follow-up 
of 27 months (95% CI 27-37). The characteristics of the OPSCC 
cohort as a whole and subdivided by HPV status, defined by HR- 
HPV qRT-PCR, are shown in Table 1. The age of patient at 
diagnosis conformed to a normal distribution as signified by a one- 
sample Kolmogorov-Smirnov test (P = 0.999). Individuals within 
the HPV-positive group were statistically significantly younger 



Table 1. Cohort characteristics as a whole an 


d classified by HPV status 


(as defined by HR-HPV qRT-PCR) 
















HPV status by HR-HPV qRT-PCR analysis 




Statistical 
significance 




Negative 


Positive 


Total 


P- value 


Patient/tumour data 


No. of patients 


45 (58%) 


33 (42%) 


78 (100%) 




Age at diagnosis (years) 


Mean 
s.e.m. 


61.3 
1.6 


54.2 
1.7 


58.3 
1.2 


0.003 


Sex 


Female 
Male 


12 (67%) 
33 (55%) 


6 (33%) 
27 (45%) 


18 (23%) 
60 (77%) 


NS 


Tumour site 


Tonsil 

Soft palate 

Base of tongue 

Oropharynx (not further spec.) 

Total 


21 (49%) 
9 (69%) 
8 (62%) 
7 (78%) 

45 (58%) 


22 (51%) 

4 (31%) 

5 (38%) 
2 (22%) 

33 (42%) 


43 (55%) 
13 (17%) 
13 (17%) 
9 (11%) 
78 (100%) 


NS 


Nodal stage 


NO 

N1 without ECS 
N2/3 or N1 with ECS 
Total 


13 (59%) 
6 (67%) 
20 (50%) 
39 (55%) 


9 (41%) 
3 (33%) 
20 (50%) 
32 (45%) 


22 (31%) 
9 (13%) 
40 (56%) 
71 (100%) 


NS 


Smoking 


Non-smoker 
<20 pack-year Hx 
^20 pack-year Hx 
Total 


6 (32%) 
9 (43%) 
21 (78%) 
36 (54%) 


13 (68%) 
12 (57%) 
6 (22%) 
31 (46%) 


19 (28%) 
21 (31%) 
27 (41%) 
67 (100%) 


0.004 


Alcohol consumption 


Non-drinker 
<28 Units per week 
^28 Units per week 
Total 


5 (50%) 
1 1 (38%) 
21 (70%) 
37 (54%) 


5 (50%) 
18 (62%) 

9 (30%) 
32 (46%) 


10 (14%) 

29 (42%) 

30 (44%) 
69 (100%) 


0.05 


Abbreviations: ECS = extra capsular spread; HR-HPV= high-risk human papillomavirus; Hx 


= history; NS = not significant; qRT-PCR = quantitative reverse transcriptase PCR. 
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than those in the HPV-negative group (mean 54.2 vs 61.3 years of 
age at diagnosis, P= 0.003). Of the 69 cases for which reliable risk 
factor data were available, those individuals who were either non- 
smokers or who had smoked <20 pack-years were statistically 
more likely to have HPV-positive OPSCC (P = 0.004). Similarly, 
there was a trend towards lower alcohol exposure in the HPV- 
positive group. There were no statistical differences between the 
groups by sex, tumour subsite or nodal category. 

Test analysis. Photomicrographs of cases classified as HPV 
positive by HR-HPV RNAscope are shown in Figure 1. The HR- 
HPV RNAscope test had a sensitivity of 97% and a specificity of 
93% against the reference test, with positive and negative predictive 
values of 91 and 98%, respectively (Table 2). Sensitivity values for 
other HPV tests when used as single tests were comparable; pl6 
IHC 97%, HR-HPV ISH 94% and to a lesser extent HPV- 16 DNA 
qPCR 91%; however, lower levels of specificity for oncogenic HPV 
were apparent for two of these tests; pl6 IHC 82%, HPV- 16 DNA 
qPCR 87%. Interpretation of more than one test per sample, in a 
diagnostic algorithm, appeared to improve specificity, but at the 
expense of sensitivity, exemplified by combined pi 6 IHC/HPV-16 
DNA qPCR; sensitivity 91% and specificity 93%. 

A comparison of the two pl6 IHC scoring techniques revealed 
no difference in pl6 status (positive or negative), either at the level 
of individual TMA cores or specific tumour cases. 



The Kaplan-Meier survival estimates illustrated in Figures 2 and 
3 and detailed in Tables 3 and 4 show the prognostic capacity of all 
HPV tests. High-risk HPV RNAscope displayed an encouraging 
capacity to discriminate survival, both in terms of OS (P< 0.001) 
and DSS (P= 0.001), and this was comparable to the reference test 
(OS P< 0.001, DSS P = 0.003). 

False-positive and false-negative reporting. High-risk HPV 
RNAscope conferred positive results for three cases (4%) where 
there was an absence of detectable HPV mRNA by qRT-PCR. 
Corresponding test results for these cases indicated that they were 
also positive by pl6 IHC, HR-HPV DNA ISH, HPV-16 DNA 
qPCR and consequently combinations of these tests. 

High-risk HPV RNAscope classified as negative, one case (1%) that 
displayed evidence of HPV-16 transcripts by qRT-PCR. The case was 
also classified as negative by pl6 IHC, HR-HPV DNA ISH, HPV-16 
DNA qPCR and consequently combinations of these tests. 



DISCUSSION 



HPV analysis of OPSCC in clinical practice is becoming a 
fundamental requirement to provide both adequate prognostic 
information for patients and to facilitate entry into appropriately 
stratified clinical trials, including those investigating the potential 



High-risk HPV 



DapB 



hUbC 




Figure 1 . Photomicrographs of OPSCC stained using RNAscope with probes for high-risk HPV, dapB (negative control) and UBC (positive control). 
The cases demonstrate a range of positive staining patterns for high-risk HPV. Cases 109 and 97 showed strong and moderate staining, 
respectively, and contained HPV-16 E6/E7 mRNA by qRT-PCR. Case 87 showed strong staining and contained HPV-18 E6 mRNA by qRT-PCR. 
Case 95 showed weak staining and was negative for HPV-16 E6/E7 mRNA, HPV-18 E6 mRNA and HPV-33 E6 mRNA by qRT-PCR (false-positive 
result). Scale bars are equivalent to 200 /im for cases 109 and 87, and 50 ^m for cases 97 and 95. 
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Table 2. Diagnostic capabilities of individual tests by comparison with 
HR-HPVqPCR 



Diagnostic 
test 


Sensitivity 

(%) 


95% 
CI (%) 


Specificity 

(%) 


95% 
CI (%) 


PPV 

(%) 


NPV 

(%) 


HR-HPV 
RNAScope 


97 


84-99 


93 


82-98 


91 


98 


p16 IHC 


97 


85-99 


82 


67-91 


80 


97 


HR-HPV DNA 
ISH 


94 


80-98 


91 


79-96 


89 


95 


Combined 
p16/HR-HPV 
DNA ISH 


94 


80-98 


91 


79-96 


89 


95 


DNA qPCR 


91 


76-97 


87 


74-94 


83 


93 


Combined 
p16/DNA 
qPCR 


91 


76-97 


93 


82-98 


91 


93 


Abbreviations: CI = confidence interval; HR-HPV DNA ISH = high-risk HPV DNA in situ 
hybridisation; IHC = immunohistochemistry; ISH = /'n situ hybridisation; NPV = negative 
predictive value; PPV = positive predictive value; qPCR = quantitative PCR. 
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Figure 3. Kaplan-Meier chart of OS as demonstrated by HR-HPV 
RNAscope. 
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Figure 2. Kaplan-Meier chart for DSS as demonstrated by HR-HPV 
RNAscope. 



to de-escalate the intensity of curative therapies. Paradoxically, 
there is no 'international standard' for defining HPV-related 
OPSCC in clinical practice and an adequately validated diagnostic 
standard for FFPE tissue has yet to be defined (Braakhuis et al, 
2009). To demonstrate the efficacy of any test, it must be appraised 
against a 'reference' or 'gold standard' test. In the context of HPV- 
driven malignancy, it is the expression of the viral oncogenes (E6 
and E7) that is the prerequisite for carcinogenesis and this has been 
hypothesised as the most appropriate analytical standard (Wiest 
et al, 2002; Smeets et al, 2007). While acknowledging that HPV 
oncogene expression is only part of a complex process of altered 
molecular pathways in viral-driven cancer, it is against quantitative 
detection of transcriptionally active virus that we sought to 
measure a novel HPV test, HR-HPV RNAscope. 

High-risk HPV RNAscope has previously shown promising 
capability when compared with other HPV diagnostic tests (Ukpo 
et al, 2011; Bishop et al, 2012) yet validation against an analytical 



standard had not been possible to date. The Mersey Head and 
Neck Oncology Research Group tissue collection benefits from a 
large series of matched fresh-frozen and FFPE tumour samples. 
The cohort was treated with primary surgical excision producing 
an abundant legacy of reserve tissue for biomarker studies. By 
contrast, other cancer centres treating OPSCC by primary 
chemoradiotherapy are usually restricted to analysis of a limited 
resource of small FFPE diagnostic biopsies. 

Previous evaluations of clinical outcomes in OPSCC based on 
HPV status have shown that individuals with HPV-positive 
malignancy have appreciably improved outcomes by comparison 
with their HPV-negative counterparts (Licitra et al, 2006; Lindquist 
et al, 2007; Fakhry et al, 2008; Lassen et al, 2009; Ang et al, 2010). 
High-risk HPV RNAscope replicated these findings and demon- 
strated a similar capacity to predict outcomes by comparison with 
the 'gold standard', as have other clinically applicable tests (Shaw 
and Robinson, 2011). 

It is, however, the high sensitivity (97%) and specificity (93%) of 
HR-HPV RNAscope that offers considerable potential as a 
diagnostic test for HPV-related OPSCC, particularly as these 
results are achieved with a single test format. The incorporation of 
control tests (UBC and dapB) on parallel sections enhances the 
quality control of test interpretation. The only other single test to 
have demonstrated comparable sensitivity in previous comparison 
with viral oncogene expression is pl6 IHC (94-100%) (Smeets 
et al, 2007; Schache et al, 2011). The level of specificity (79-82%) 
demonstrated by pl6 under the same conditions, however, is 
somewhat lower, due mostly to alternative, and as yet unexplained, 
elevations of pl6 expression in HPV-negative malignancy (Bishop 
et al, 2012; Harris et al, 2011). It is for this reason that algorithms 
combining both pl6 IHC- and HPV-specific tests have been 
advocated (Westra, 2009). Investigation of the potential differences 
between pl6 IHC scoring techniques was undertaken by applica- 
tion of both the currently applied standard for pl6 IHC analysis 
(Singhi and Westra, 2010), strong and diffuse nuclear and 
cytoplasmic staining in >70% of the tumour, and the recently 
described H score analysis (Jordan et al, 2012), derived from the 
cross-product of staining intensity and proportion of tumour. 
Interestingly, both of the pl6 IHC scoring techniques gave 
identical results and therefore had no apparent bearing on either 
the sensitivity/specificity of pl6 IHC or its prognostic capacity. 

High-risk HPV RNAscope classified three cases as HPV positive 
in the absence of detectable HPV mRNA. It is conceivable that the 
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Table 3. Kaplan-Meier survival estimates of c 


disease-specific survival (DSS) and associated hazard ratios f 


Dr individual HPV diagnostic tests 




DSS 


Three-year 

survival 
probability 


95% CI 


Log-rank 
P- value 


Hazard 
ratio 


95% CI 


P- value 


HR-HPV RNAscope 


HPV -ve 
HPV +ve 


0.6 
0.96 


0.45-0.8 
0.88-1.0 


0.0011 


11.9 


1 .6-90.8 


0.017 


HR-HPV qRT-PCR 


HPV - ve 
HPV +ve 


0.62 
0.95 


0.47-0.81 
0.87-1.0 


0.0026 


10.2 


1.2-77.9 


0.025 


p16 IHC 


HPV - ve 
HPV +ve 


0.61 
0.9 


0.46-0.82 
0.81-1.0 


0.0093 


4.1 


1.1-14.6 


0.031 


HR HPV DNA ISH 


HPV - ve 
HPV +ve 


0.63 
0.92 


0.48-0.82 
0.82-1.0 


0.0074 


5.2 


1.2-23.3 


0.031 


p16 IHC/HR-HPV DNA ISH 


HPV - ve 
HPV +ve 


0.63 
0.92 


0.48-0.82 
0.82-1.0 


0.0074 


5.2 


1.2-23.3 


0.031 


DNA qPCR 


HPV - ve 
HPV +ve 


0.62 
0.92 


0.47-0.82 
0.82-1.0 


0.0035 


5.5 


1 .2-24.6 


0.025 


p16 IHC/DNA qPCR 


HPV - ve 
HPV +ve 


0.62 
0.95 


0.47-0.81 
0.87-1.0 


0.0022 


10.6 


1 .4-80.8 


0.023 


Abbreviations: CI = confidence interval; HR-HPV = high-risk human papillomavirus; IHC = immunohistochemistry; ISH = /'n situ hybridisation; qPCR = quantitative PCR; qRT-PCR = quantitative 
reverse transcriptase PCR. 



samples might harbour other HR-HPV genotypes not included in 
the reference test, which was restricted to the analysis of the three 
most common HPV genotypes isolated from OPSCC (HPV-16, -18 
and -33). It is interesting to note that one of the three cases had 
high levels of HPV-16 E2 expression detected by qRT-PCR 
(unpublished data). E2 is a known transcriptional repressor of E6 
and E7 genes, and its influence may have been sufficient to reduce 
E6 and E7 transcript levels below the detection threshold of 
qRT-PCR while remaining within the detection range of HR-HPV 
RNAscope. Alternatively, the mismatch between the qRT-PCR 
result and the tests on FFPE raises the possibility of methodological 
flaws, despite the use of stringent experimental design and 
detection protocols to quality assure test results. 

The solitary case reported as negative by HR-HPV RNAscope 
demonstrated an expression level for both E6 and E7 that was low 
by comparison with other samples; however, it was not the lowest 
and remained within the threshold for detection set before analysis 
of the samples. Interestingly, this case was similarly 'misclassified' 
by both pl6 IHC and HR-HPV DNA ISH. It is possible that 
fixation and processing parameters may have resulted in 
suboptimal preservation of the target molecules; however, given 
that the FFPE samples were all derived from the same diagnostic 
service this seems unlikely. 

The clinical significance of HPV testing may reach considerably 
further than merely guiding expected prognosis. Should successful 
primary outcomes be apparent from prospective randomised 
clinical trials seeking to modify treatment on the basis of HPV 



status, then further de-escalation of therapy may be advocated. 
Any such move will necessitate ultimate stringency for the 
diagnostic testing to avoid incorrect classification of HPV-positive 
and -negative cases. The risks of inaccurate molecular diagnosis 
include missed opportunities to allocate cases to the novel 
intervention arm of a trial or, of greater importance, the delivery 
of potentially subtherapeutic treatment to individuals with HPV- 
negative OPSCC. It is questionable whether the levels of sensitivity 
and specificity demonstrated to date by single or combined-test 
algorithms for HR-HPV diagnostic testing are adequate to guard 
against such eventualities; however, RNAscope seems to offer a 
substantial improvement. Several criteria for an acceptable test of 
HPV status in OPSCC must be met before recommending a 
specific HPV testing strategy. The test or combination of tests must 
have high sensitivity and specificity against an accepted analytical 
gold standard and have excellent prognostic capacity. Ideally, the 
test would be feasible as part of the routine diagnostic process, 
reproducible between laboratories and cost effective. In this study, 
HR-HPV RNAscope showed a high degree of accuracy against the 
most appropriate analytical gold standard and was the best 
discriminator of disease- specific and OS. Before adoption of 
HR-HPV RNAscope into clinical practice could be formally 
advocated, this test requires mandatory approval as an in vitro 
diagnostic device; however, the impending application and 
availability of HR-HPV RNAscope to a widely available automated 
staining platform (Ventana Medical Systems Inc.) will facilitate 
standardisation of test conditions and reproducibility between 
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Table 4. Kaplan-Meier survival estimates of c 


overall survival (OS) and associated hazard ratios for individual HPV diagnostic tests 






OS 


Three-year 

survival 
probability 


95% CI 


Log-rank 
P- value 


Hazard ratio 


95% CI 


P- value 


HR-HPV RNAscope 


HPV -ve 
HPV +ve 


0.47 
0.91 


0.33-0.68 
0.8-1.0 


0.0002 


8.3 


1.9-35.9 


0.004 


HR-HPV qRT-PCR 


HPV - ve 
HPV +ve 


0.5 
0.91 


0.35-0.7 
0.79-1.0 


0.0007 


7.1 


1 .7-30.8 


0.008 


p16 IHC 


HPV - ve 
HPV +ve 


0.49 
0.83 


0.34-0.72 
0.71-0.98 


0.0044 


3.3 


1.2-9.1 


0.02 


HR-HPV DNA ISH 


HPV - ve 
HPV +ve 


0.5 
0.88 


0.35-0.71 
0.75-1.0 


0.0015 


4.9 


1.4-16.8 


0.011 


p16 IHC/HR-HPV DNA ISH 


HPV - ve 
HPV +ve 


0.5 
0.88 


0.35-071 
0.75-1.0 


0.0015 


4.9 


1.4-16.8 


0.011 


DNA qPCR 


HPV - ve 
HPV +ve 


0.5 
0.85 


0.34-0.72 
0.72-1.0 


0.0016 


2.7 


1.2-11.1 


0.019 


p16 IHC/DNA qPCR 


HPV - ve 
HPV +ve 


0.49 
0.91 


0.34-0.7 
0.79-1.0 


0.0005 


7.4 


1.7-32.0 


0.007 


Abbreviations: CI = confidence interval; HR-HPV = high-risk human papillomavirus; IHC = immunohistochemistry; ISH = /'n situ hybridisation; qPCR = quantitative PCR; qRT-PCR = quantitative 
reverse transcriptase PCR. 



laboratories. These features raise the possibility that HR-HPV 
RNAscope could be developed to provide the 'clinical standard' for 
assigning a diagnosis of HPV-related OPSCC. 
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